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Abstract — This paper proposes a novel approach, based on un- 
equal error protection, to enhance rateless codes with progressive 
recovery for layered multimedia delivery. With a parallel en- 
coding structure, the proposed Progressive Rateless codes (PRC) 
assign unequal redundancy to each layer in accordance with their 
importance. Each output symbol contains information from all 
layers, and thus the stream layers can be recovered progressively 
at the expected received ratios of output symbols. Furthermore, 
the dependency between layers is naturally considered. The 
performance of the PRC is evaluated and compared with some 
related UEP approaches. Results show that our PRC approach 
provides better recovery performance with lower overhead both 
theoretically and numerically. 

I. Introduction 

Rateless codes, also known as fountain codes (T), have 
been proposed as one of the promising error-correcting codes 
recently. It has an asymptotic optimal recovery property over 
binary erasure channels (BEC) without any knowledge of the 
channel. Compared with conventional forward error correction 
(FEC) codes, e.g. Reed-Solomon (RS) code, rateless codes can 
generate a potentially infinite stream of independent encoding 
symbol^] on the fly, whereas the conventional ones must 
be selected a fixed code rate in advance according to the 
channel state. Besides, rateless codes have a lower encoding 
and decoding complexity. Therefore, rateless codes can be very 
suitable for transmission data packets on different kinds of 
lossy channels, especially for fast time-varying channels or 
broadcast/multicast channels. In those scenarios, rateless codes 
can be adapted to the channel very well even with unknown or 
time-varying erasure probabilities, which means rateless codes 
can be widely applied in many applications such as Internet, 
mobile TV. 

Multimedia contents are fragile to packet losses. And the 
error effects of packet losses change with their importance. 
Moreover, in order to achieve scalable and graceful streaming, 
layered multimedia codecs have been proposed in standards, 
such as JPEG2000 [2| and the scalable video coding (SVC) 
O extension of the H.264/AVC standard. In these standards, 
media source can be encoded into several stream layers with 

'Note that a symbol is the smallest encoding unit of data, which have the 
same size. One or more symbols will be contained in a packet. 



different importance. Lower layers, which should be decoded 
first, are more important and the loss of a lower layer will 
affect all other higher layers. So it needs to be considered to 
give stronger FEC protection to more important layer packets. 

Luby Transform (LT) codes flU and Raptor codes |]5], 
as two state-of-the-art rateless codes, have been proved to 
be efficient FEC techniques to increase service robustness 
in multimedia delivery systems. What's more, Raptor codes 
have been adopted as the application layer FEC solution in 
current standards, such as 3GPP MBMS (6) and DVB-H 0. 
Nevertheless, in traditional rateless codes, all stream packets 
are protected by equal error protection (EEP). If receivers 
are not able to receive enough symbols, none of the source 
symbols can be recovered. Therefore, rateless codes with 
unequal error protection (UEP) are required to protect layered 
stream data in a more efficient way. 

Recently, several rateless codes with UEP property have 
been proposed, which benefit in performance of the transmit- 
ted layered multimedia. In [8|-[11|, each layer is protected 
separately by assigning different redundancy according to their 
importance, but it is inefficient sometimes that higher layer's 
data may be decoded before the lower layer's, since the 
dependence between layers is ignored. In iflZl . ||T3l . with a 
layer-aware recovery, they sacrifice the protection for higher 
layers because the irregular encoding structure for high layers 
is inefficient, where the full recovery performance is degraded. 

In this paper, a novel UEP rateless approach, named Pro- 
gressive Rateless codes (PRC), is proposed. In this approach, 
taking the dependence into account, we reshape the stream 
layers and encode them parallelly without weakening the pro- 
tection of higher layers. As output symbols received gradually, 
the stream layers can be recovered progressively one after 
another following their importance. 

The remainder of the paper is organized as follows. In 
Section m we will introduce the background of rateless codes 
and give an overview of some related rateless UEP approaches. 
Section [Til] generally describes our approach and conducts a 
theoretical probability analysis of PRC, in comparison with 
other approaches. Some numerical results are shown in Section 
HVl Finally, we conclude the paper in Section [V] 



II. Background and Related Work 

A. Review of rateless codes 

LT codes is the first practical rateless code. Assume that 
we have k source symbols to be transmitted. Let Cl(x) = 
J2i=i &iX l represent a degree distribution, f2j stands for the 
probability of degree i and satisfies Y^i=i ^» = 1- The 
procedure of generating a encoding symbol is as follows. 

1) Select an encoding degree d with distribution fi(x). 

2) Choose d input symbols randomly and uniformly in k 
source symbols as neighbors of the encoding symbol. 

3) Perform bitwise XOR operation on the d chosen symbols 
to generate the encoding symbol. 

After the above procedure, an encoding symbol is transmit- 
ted to the receiver. If d = 1, the encoding symbol is just a 
duplication of the unique input symbol. This procedure will be 
executed repeatedly and a potentially infinite encoding symbol 
stream can be generated until enough encoding symbols are 
collected at the receiver to recover all source symbols. 

At the receiver, both belief propagation process (BP) J4] 
and maximum likelihood decoding (ML) [6] can be applied 
to the decoding of LT codes. The procedure of BP process is 
as follows. 

1) Initial step: search for receiving symbols with degree 
one and release them to recover their unique neighbor 
input symbols to a buffer, called the ripple. 

2) Process every input symbol in the ripple as follows until 
the ripple becomes empty. 

a) Remove the input symbol from receiving symbols 
as a neighbor. 

b) Release such receiving symbols subsequently with 
exactly one remaining neighbor and recover their 
neighbors to the ripple. 

BP process fails if at least one source symbol remaining 
unrecovered in the end. The key point of successful decoding 
is the perfect design of the degree distribution. Fortunately, 
it was proved in ||U such distribution exists and all source 
symbols can be recovered by any (l+e)k encoding symbols, e 
is the decoding overhead, it has achieved capacity-approaching 
behavior with very low overhead when k — > oo, e — > 0. 

ML decoding, also known as full rank decoding, is executed 
by solving a set of linear equations in F§, since each encoding 
symbol is a linear combination of source symbols. It will be 
successful iff. the set of equations is full rank. Compared with 
BP process, ML decoding has higher decoding efficiency but 
higher decoding complexity. 

Raptor codes J5), as an extension of LT codes, have been 
proposed with linear time encoding and decoding using a 
pre-coder of low-density parity-check (LDPC) codes. Our 
approach will follow Raptor codes with a modified encoding 
structure. 

B. Related work. 

With applying rateless codes with UEP, various layered 
delivery techniques have been studied, which can be divided 
into three groups. 
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(a) A block of a two-layer SP-FEC with N output symbols. 
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(b) A block of a two-layer LA-FEC with N output symbols. 

Fig. 1 . Structure of two types of separate unequal protection strategy, whose 
N output symbols are transmitted from left to right sequentially. 

Rahnavard and Fekri [8 1, first of all, presented a distribution- 
based approach. They introduced UEP at the LT encoding 
stage and designed a nonuniformly degree distribution such 
that lower layer symbols can be selected with higher proba- 
bility. With achieving unequal recovery of different layers, the 
altered distribution weakens the code performance and results 
in a larger overhead. 

Another group of UEP designs are pre-coding based ap- 
proaches [10], IfTTI . Without making modifications to the 
traditional rateless code structure, firstly layer packets are 
pre-coded with different code rate proportionally according 
to their importance, where lower layer packets are assigned 
to lower pre-coding rate. Then pre-coded packets are passed 
to a rateless encoder. Since the intermediate performance of 
rateless code is poor, the recovery of lower layers suffers. 

The third and typical one is the redundancy-based strategy 
[9 1, lfl2l . Ifl3ll . As shown in Fig.Q] suppose that there are two 
stream layers to be delivered as Layer 2 is dependent on Layer 
1. Stream layers are encoded by two different rateless encoders 
and given redundant symbols proportionally with their impor- 
tance. There are two types of such strategy H131 . The separate 
FEC (SP-FEC) protects the two layers independently, while 
the layer-aware FEC (LA-FEC) extends protection following 
the dependency between stream layers, i.e., Layer 1 is not only 
protected by FEC 1 but also protected by FEC 1 +2, together 
with Layer 2. The LA-FEC improves the recovery of Layer 1 
at the expense of Layer 2, since the encoding structure of FEC 
1+2 is slightly changed from original rateless codes. Next, we 
will have a detailed description of our approach and compare 
it with the redundancy-based approaches. 

III. Progressive Rateless Codes 

In this section, we propose the Progressive Rateless code 
(PRC) to enhance traditional rateless codes with UEP capa- 
bility. In our approach, to guarantee the optimized recovery 
performance, we alter the encoding structure with maintain- 
ing the parameters of rateless code, e.g. degree distribution. 
Meanwhile, with the efficient recovery of rateless codes, the 
dependency between layers has been satisfied to come to a 
progressive recovery of the layered multimedia. 
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Fig. 2. Encoding procedure of a block of a two-layer PRC, whose N output 
symbols are transmitted from left to right sequentially. 



A. Design and Implementation 

We consider a layered multimedia data stream to be trans- 
mitted over an erasure channel. Assume that an m-layer video 
stream is partitioned into several source blocks with the size of 
K symbols, where the importance of symbols decreasing from 
Layer 1 to Layer m. Let ki be the number of source symbols 
of Layer i, so that K = 2~2iLi ki- Let T be the symbol length 
in bytes, thus each layer has ki • T bytes and the total length 
of the block will be K ■ T = YT=i fc * ' T b y tes - Note ^ 
^ is a constant for Layer i in a certain layered stream as the 
source block size K changes. 

Given total broadcasting bandwidth, the overall coding rate 
7 = ^ is fixed for all possible K, where N is the output block 
size, i.e. number of output symbols for each source block, to 
protect the layered data stream from packet losses. Thus the 
total length of redundant symbols is (N — K)-T bytes. Based 
on these conditions, our PRC approach will generate encoding 
symbols in a parallel way. 

Before rateless encoding, all m layers are reshaped with 
symbol lengths of {Ti, Ta, T m } bytes respectively, ensuring 
T = 2~2i=i Ti- Then the number of reshaped symbols in Layer 
i becomes k* = H^-. Each reshaped layer is passed through 
a rateless encoder to generate N reshaped encoding symbols, 
where an output symbol is formed by packing m reshaped 
encoding symbols, one from each encoding layer. So there will 
be N output symbols with each symbol packing encoding data 
from all layers. As shown in Fig. [2] a two-layer PRC layered 
delivery is illustrated, where an output symbol is generated by 
combining two reshaped encoding symbols. 

At the decoder, assume that R output symbols are received, 
of course R < N due to packet losses. The received symbols 
are firstly unpacked to separate reshaped symbols of each 
layer, which are then passed to m different rateless decoders, 
respectively. Lastly the message block are recovered layer by 
layer at the decoders. 

B. Recovery Performance Analysis 

In this part, we will make an combinational analysis of 
recovery probability of PRC, in comparison with SP-FEC and 
LA-FEC in Fig. Q] To make a fair comparison, for Layer i, we 
have redundant data of the equal length in all approaches, i.e., 
Pi ■ T — (N — k*) ■ where pi is the number of redundant 
symbols. And then we have the number of output symbols 
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which shows the coding rate of reshaped Layer i is also r, . 
In SP-FEC, let r\i = ^ be the output ratio of Layer i, which 
will be a constant once T{ is determined. 

Let Pii(R) be the recovery probability of Layer i in PRC. 
Without loss of generality, we consider the ideal recovery of 
rateless codes, i.e., k* source symbols can be recovered as 
soon as R > k* encoding symbols are received. Then we 
have 

Pr^) = ( 1 ' ^ (2) 
V ; [0, R<k*. 

which indicates that for Layer i, it can be recovered from 
at most N — k* packet losses with probability 1. Therefore, 
to recover layered data stream progressively from Layer 1 to 
Layer m, we can make k\ < k\ < ... < k* m . From Eq. (Q~|i, we 
know that it can be also represented by v\ < r% < ... < r m . 
So we can protect Layer i by assigning suitable r.i, expecting 
to recover it after receiving r*i ratio of output symbols. 

Following the results in 0~3|, we only investigate the 
SP-FEC without considering dependency for simplicity. The 
analysis of LA-FEC will be similar to that and when N 
grows large, there will be little difference between the two 
approaches. 

In SP-FEC, let Pr^i?) be the recovery probability of Layer 
i. With the ideal recovery assumption of rateless codes, it can 
be recovered by at least ki out of rii output symbols from 
Layer i. 

. For R < k h Pr-(i?) = 0. 

. For h < R < N - (tm - h), 



min{i?,ni} f ni \ (N 
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x—ki 



roin{R,nt} /R\/N-R\ 
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(3) 

. For R> N — {iii - h), Pr'^R) = 1. 

It's clear that Pr^ii) is the tail probability of a hypergeo- 
metric distribution with parameters of X ~ T-L(rii, R, N), i.e., 



PT i (R) = P(X>k i \n i ,R,N) 



(4) 



Let r = R/N be the received ratio of all output symbols. 
In Fig. [3] several curves of recovery probability are shown, 
normalized by the received ratio. Note that in practise typically 
multimedia codecs work well under a packet loss rate (PLR) 
of no more than 10~ 4 , so the recovery performance can be 
measured by the Successful Received Ratio (SRR), where the 
recovery probability goes above 1 — 10~ 4 . From Fig. [3] we 
can see the SRR of PRC is much smaller than SP-FEC for 
both Layer 1 and Layer 2. 

To find the relationship between the two approaches, we will 
show some properties of Prj(i?) as the following lemmas. 

Lemma 1. Pr ; (i?) is a non-decreasing function of the number 
of received symbols R. 
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where <I>(x) is the cumulative distribution function of the 
standard normal distribution. With the monotonicity property 
of $(x), it's straightforward to show that Prj (Nr) increases 
with N if r > ri. ■ 
Lemma |2] shows that the recovery probability of each Layer 
i will increase with N when a certain ratio of symbols are 
received, as long as the ratio is more than rj. If the PLR is 
no more than 1 — n, we can improve the performance by 
assigning a lager block size K. 

Lemma 3-Ifr is any constant and r > when output block 

size N — > oo, 
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Fig. 3. Recovery probability of proposed PRC and SP-FEC with receiving 
different ratio of output symbols. Note that LI and L2 denote Layer 1 and 
Layer 2, respectively. The coding rate for the two layers are r\ = 1/2 and 
r 2 = 4/5. 

Proof: From Eq. ®, if R < fa or R > N — — fa), 
P^(ii) is a constant. Otherwise we can obtain 

minfi?.ri«l minfK.ni— 1} 

x—ki x—ki — 1 



Pr ivJ R+l) 



Pr,(iJ) 
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which shows Pr^(i?) is increasing strictly when fa < R < 
N-(ni-ki). M 
Lemma [T] shows the recovery probability of any Layer i 
increases with the number of the received symbols, which is 
in accordance with our intuition. Furthermore, given a fixed 
received ratio of output symbols, we have Lemma [2] when the 
output block size N increases with a fixed overall coding rate. 

Lemma 2. If r is any constant and r > ri, Pr { (N ■ r) is an 
increasing function of the output block size N. 

Proof: With the property of hypergeometric distribution, 
the mean [i and the variance a 2 of X are given by 



pt, = R-—,a 2 = N ■ r(l — r)^(l - -) 



(5) 



AT v 'N x N 

If N is large enough, X can be approximated by a normal 
distribution, if the following conditions can be satisfied, 

1) ■& — > r is a constant. 

2) jj- — > T]i is a constant. 

Then X approaches to M{fx, cr 2 ), where 

P(X = x\R,th,N) ' 



2na 



(6) 



Since ki = mr 
Pr-(A^r) w 1 - <I> ( ! = <I> 



NrjiTi, we can derive with Eq. dU, 

fa — fi\ , / (r — n)vN 



Vr(l-r)(l-7?i) 



(7) 



Proof: Firstly we will show that Pr^AT • r) — >• 1. This is 
quite easy to be shown from Eq. (0, since — > 1 when x 
goes to infinity. 

Recall Eq. ([T]), if r > n, R > Nri — k*. So we have 
Pr^(iV • r) — 1. Thus we we conclude the assertion. ■ 

Lemma [3] shows the asymptotic recovering probability of 
SP-FEC is equal to PRC, which means PRC seems to be 
optimal for the SP-FEC. We also notice that the SRR of SP- 
FEC approaches to that of PRC when N grows. In other words, 
for moderate output block size of N, PRC will theoretically 
outperform SP-FEC with lower overhead. Next, we will show 
some numerical results to confirm those conclusions. 

IV. Simulation Results 

In order to verify the asymptotic analysis developed in 
Section IIII-BI we performed numerical simulations of PRC 
compared with SP-FEC and LA-FEC [ 13 1. In our simulations, 
we apply the Raptor codes specified in [6 1 as the rateless codec 
in all approaches, which has achieved an efficient recovery 
with a very low overhead. 

Assume that we have a two-layer multimedia data stream, 
e.g. a MPEG TS stream with a base layer and an enhanced 
layer, to be transmitted. The symbol length is T — 188 bytes. 
The layered steam data can be partitioned into message blocks 
of different K, where = j§ and = j| are constant. To 
have a progressive recovery of the layered stream, we assign 
r\ = 0.5 and T2 = 0.8 for the two layers. 

We have performed two cases on (N — 1000, if = 650) 
and (N = 500, K = 325) to evaluate the PLR of the two 
layers after recovering, shown in Fig. |4]and Fig. ^respectively. 
It can be seen in the figures that both Layer 1 and Layer 2 
of the PRC are recovered around 50% and 80% as expected 
with a very low overhead 2%(A^ = 1000) to 4%(A^ = 500). 
Thus we have achieved a progressive recovery of the layered 
stream. 

Fig. 2] shows the PLR of Layer 1 of all the three approaches 
with the received ratio near 50%. It's clear that the PRC 
outperforms both SP-FEC and LA-FEC with reducing more 
than 5%(N = 1000) to 7%(N = 500) received symbols below 
the PLR of 10~ 4 . When the output block size N increases, 
the PLR at the same received ratio decreases. Moreover, the 
gap between PRC and the other two approaches becomes 
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Fig. 4. Packet loss rate of Layer I of the proposed PRC versus other UEP 
approaches after receiving a certain ratio of output symbols. Both N = 1000 
and N = 500 are illustrated. 
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Fig. 5. Packet loss rate of Layer 2 of the proposed PRC versus other UEP 
approaches after receiving a certain ratio of output symbols. Both N = 1000 
and N = 500 are illustrated. 

closer, which meet our conclusions in Lemma [2] and Lemma 
[3] Note that the curves of SP-FEC and the LA-FEC are 
too close to tell, implying that the recovery performance of 
the two approaches are nearly the same. The reason is the 
efficient recovery of Raptor codes, i.e., Layer 1 has been 
almost recovered before Layer 2 is just to be recovered. 

Fig. [5] demonstrates the PLR of Layer 2 with about 80% 
output symbols received. It also indicates the advantage of 
PRC as in Fig. 0] However, we can see in Table |U using the 
PRC, there will be a little longer delay for Layer 1, while 
the buffering time for Layer 2 is saved. Consequently, our 
approach can provide each layer with a progressive recovery 
according to its importance. Moreover, it reduces the received 
overhead efficiently compared with the other UEP approaches. 

V. Conclusion 

In this paper we have presented a novel rateless codes with 
progressive recovery, on the basis of unequal error protection 
for layered multimedia delivery. Considering the different 
importance of layers of multimedia data, we protect each 



TABLE I 

Average buffering time to recover a message block, 
normalized by the time to send a symbol. 





N = 1000 


N = 500 


Layer I 


Layer 2 


Layer 1 


Layer 2 


PRC 


501.60 


801.59 


251.63 


401.62 


SP-FEC 


251.62 


901.62 


127.01 


451.49 


LA-FEC 


252.52 


902.21 


127.80 


451.92 



layer with unequal redundancy. Each output symbol in the 
proposed approach is packed with encoding data from all 
layers, whereas conventional approaches pack output symbols 
separately. Then the proposed approach shows promise of 
recovering the layered stream progressively according to the 
dependency at designated received ratio. In comparison with 
different related UEP approaches, theoretical and numerical 
results suggest the superiority of the proposed approach with 
reduced overhead of all stream layers, indicating that our 
approach can be widely employed to multimedia delivery 
implementations, especially for layered multicast or broadcast. 
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